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ABSTRACT 


The Operations and Maintenance, Navy (O&MN) budget for the two Navy Inven- 
tory Control Points (ICP’s) has shown an overall increase over the past 15 years. How- 
ever, the numerous outputs or workload measures being used at the ICP’s do not seem 
to show the same trend as O& MN. The Naval Supply Systems Command (NAVSUP) 
wants to relate the budget to the various workload measures. In fact, NAVSUP would 
like a single measure of workload applicable to the two ICP’s which could explain most 
of the behavior of O& MN. This measure of workload could serve as a simple but useful 
predictive tool for budget requests. This thesis examined data for O& MN and workload 
indicators representing the major functions performed by each ICP. The data covered 
the time interval from 1973 to 1987. Models using single and multiple variables were 
then developed through exploratory data analysis and regression analvsis in an attempt 
to describe how O& MN 1s related to or can be explained by the workload indicators. 
The models using only a single workload measure did not do very well at explaining the 
behavior of O& MN, although if a single variable model must be chosen, the number of 
repairable line items appeared to be the best O& MN predictor. The multivariate models 
Were too data limited to be useful immediately. However, the potential for developing 


accurate models using multiple variables appears to be very good. 
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I. INTRODUCTION 


A. BACKGROUND 
1. Naval Supply Systems Command (NAVSUP) 

Under the authority of the Secretary of the Navy, NAVSUP directs the opera- 
tion of the Navy supply system. Its mission is to develop, manage and operate the Navy 
supply system to provide supplies and services to satisfy peacetime and wartime fleet and 
other customer mission requirements. Support of the Naval operating forces and the 
maritime strategy is the ultimate objective of every task and function performed by 
NAVSUP. [Ref: 1] 

2. Inventory Control Points (ICP) 

The inventory management responsibilities of NAVSUP are implemented 
through ICP’s. There are two Navy ICP’s: Ships Parts Control Center (SPCC) for mar- 
itime applications and Aviation Supply Office (ASO) for aviation applications. Their 


missions and goals are to: 


1, Provide worldwide acquisition and control of weapons systems and material. 
2. Provide total life cycle configuration management, logistics support data, and sup- 
ply support for assigned weapons systems. 
3. Provide inventory management for assigned secondary items. 
4. Contribute to the readiness and sustainability of the fleet. [Refs. 2,3] 
To accomplish these, the ICP’s perform similar major functions 1n the areas of Inventory 
Management, Customer Support, Purchasing Actions, and System Provisioning. On the 
resource side, both activities use Operations and Maintenance, Navy (O&MN) funds to 
finance their operations. 
3. Inputs and Outputs 
Figure 1 shows the activities of an ICP during a particular fiscal year. The ICP 
uses its resources of O& MN and End Strength (number of personnel) to perform its 
major functions of Inventory Management, Purchasing, and Provisioning. How an ICP 
performs is mainly reflected through a performance indicator known as Supply Material 
Availability or SMA. This is a measure of the annual percent of requisitions received 
which are filled immediately. Several outputs indicate the amount of work done by an 
ICP. Clearly, there is quite a diversity of outputs which makes it seem unlikely that only 


one could serve to forecast O& MN input requirement. 


Neu rs ICP*®ACI Ry re. OUTrEunS 


PROVISIONING LINE ITEMS MANAGED 


O&MN DOLLARS BURGTRIO TING DEMANDS SATISFIED 
PURCHASE ACTIONS 
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E 
CUSTOMER SUPPORT ETC. 





Figure 1. Inputs and Outputs at a Navy ICP during a Fiscal Year. 


4. Measures Of Workload 

The concern over measures of workload for the ICP’s was originally raised by 
Rear Admiral James B. Whitaker, then Deputy Commander for Systems Integrity (SUP 
OOX) at the Naval Supply Svstems Command (NAVSUP), Washington, D.C. He stated 
that “although the Operations and Maintenance (O& MN) budget has shown an overall 
increase after years of operation, most workload indicators actually decreased ” [Ref. 
4). The increase shown by O&MN is not just the effect of inflation. When annual 
O&MN obligations were converted to their equivalent FY 87 dollars as part of this 
thesis, there was an Overall increase of more than 50 percent for both ASO and SPCC 
from 1973 to 1987. Admiral Whitaker further expressed his interest in “finding out what 
is the single workload measure that drives the ICP into their level of spending ” [Ref. 
4). If such a single variable can be found, a predictive model could be developed to use 
in the budgeting and operational planning process by NAVSUP. Such a model could 
answer questions like 


1. If a certain level of workload is desired from the ICP, how much O& MN funding 
is needed? 

2. If a certain level of funding is authorized for the ICP, what level of workload is 
expected? 


While one may be desirable, there presently exists no single measure of workload that 


encompasses all ICP functions [Ref. 5]. 


B. OBJECTIVE 

The objective of this thesis is to determine by using exploratory data analysis and 
regression analysis if there is a single workload indicator which can explain the behavior 
of O& MN for both ICP’s. However, if a single variable model can not be found, then 
multiple variable models will be considered and the simplest of those identified. 


c SCOPE 

This thesis will use annual and quarterly workload indicators from both of the Navy 
ICP’s. The number of observations of these indicators is constrained by the availability 
of data. Since there 1s no prescribed time as to how long reports and files must be kept 
by the ICP’s, the indicators may not have the same number of observations. All indica- 
tors are related to the major functions performed by the ICP’s to accomplish their 


nussions. 


D. PREVIEW 

Chapter II presents the various single variable models which will be tested and de- 
scribes how to evaluate the goodness of a given model. Chapter III presents the results 
of single variable analyses and discusses the inadequacy of using single variable models. 
Chapter IV presents the multiple variable models which will be tested and the results of 
the multiple variable analyses. Chapter V presents a summary of this thesis, conclusions 


and recommendations. 


Il. MODELS WITH A SINGLE INDEPENDENT VARIABLE 


This chapter will apply the typical steps taken in a statistically based investigation 


of sets of data to build a model which will relate outputs to needed O& MN funds. 


Throughout this thesis, O& MN funds will be referred to as the dependent variable and 


all others will be referred to as candidate independent or explanatory variables. 


A. STEPS 


1. Determination of Variables 


Every variable considered should conceptually have an impact on the stated 


Strategic plan of NAVSUP and missions of the ICP. It must also have relevance to the 


major functions performed by the ICP’s and somehow contribute to their measure of 


effectiveness which 1s Supply Material Availability (SMA). The candidate explanatory 


variables were determined by the following methods: 


E 


ty 


Interviews Were conducted with NAVSUP and ICP personnel from different func- 
tional groups and work levels. 


NAVSUPNOTE 5200 provided a listing of workload profile indicators that should 
be used in NAVSUP activities. 


Several manuals and instructions were studied to obtain a better perspective of ICP 
organizations and functions. 


The variables used in this thesis grouped in accordance with the major functions per- 


formed by an ICP are listed below. 


a. List Of Candidate Variables For SPCC 


. Inputs 


a. Annual and Quarterly OX MN 
b. Annual NSF Obligations (NSF) 
c. Annual End Strength (E/S) 
Outputs 


a. Inventory Management. 1H Cog line items make up most of the consumable 
material managed by SPCC while 7 Cog line items make up most of the repair- 
able line items. 


1) Annual and Quarterly Total line items (TOTAL L.I.) 
2) Annual and Quarterly 1H Cog line items (1H COG L.I.) 
3) Annual and Quarterly 7 Cog line items (7 COG L.I.) 


4) Annual and Quarterly Repairable line items (REP L.I.) 
b. Customer Support. Demands are in number of units. 
1) Annual and Quarterly Total demands (TOTAL DEM) 
2) Annual and Quarterly Demands for 1H COG items (1H COG DEM) 
3) Annual and Quarterly Demands for 7 COG items (7 COG DEM) 


c. Purchase actions. Beginning in FY 1983, the cut-off amount between small and 
large purchase changed from under $10,000 to under $25,000. 


1) Annual Total purchase (TOT PURCH) actions 

2) Annual Small purchase (SM PURCH) actions 

3) Annual Large purchase (LG PURCH) actions 

4) Annual Purchase for stock (STK PURCH) actions 

5) Annual Purchase for spot requirements (SPOT PURCH) actions 

6) Annual Purchase actions for consumable line items (CONS PURCH) 
7) Annual Purchase actions for repairable line items (REP PURCH) 


d. System Provisioning. Provisioning includes the determination of the range and 
depth of spare parts required to support a weapons system in its life cycle. When 
new equipment is inducted into the Navv inventory, this usually results in the 
addition of line items managed by an ICP. When an equipment is removed from 
the inventory (say, when it becomes obsolete) this results in deletion of line 
items. 


1) Annual Number of Items added to current inventory (ITEM ADD) 
2) Annual Number of Items deleted from current inventorv (ITEMS DEL) 
e. Performance Indicators 
1) Annual and Quarterly Supply Material Availability (SMA) 
2) Annual Number of Backorders (BB) established per vear 
3) Annual Material Outstanding Obligations (MOOS) at the end of a fiscal vear 


b. List Of Candidate Variables For ASO 
1. Inputs 
a. Annual and Quarterly OMN 
b. Annual NSF Obligations (NSF) 
c. Annual End Strength (E/S) 
2. Outputs 


a. Inventory Management. IR Cog line items make up most of the consumable 
material managed by ASO while 7R Cog line items make up most of the re- 
pairable line items. 7R Cog line items are aeronautical Depot Level Repairables 


(DLR) while Repairable line items 1s the totality of all Aviation DLR’s managed 
bv ASO. 


1) Annual and Quarterly Total line items (TOTAL L.I.) 
2) Annual and Quarterly IR Cog line items (IR L.I.) 
3) Annual and Quarterly 7R Cog line items (7R L.I.) 
4) Annual and Quarterly Repairable line items (REP L.I.) 
5) Annual and Quarterly Program Support Items (PSI) 

b. Customer Support. Demands are 1n number of units. 


1) Annual and Quarterly Total Demands (TOTAL DEM) 
2) Annual Demands for IR COG items (IR COG DEM) 
3) Annual Demands for 7R COG items (7R COG DEM) 


c. Purchase actions. Beginning in FY 1983, the cut-off amount between small and 
large purchase changed from under $10,000 to under $25,000. 


1) Annual Total purchase (TOTAL PURCH) actions 
2) Annual Small Purchase (SM PURCH) actions 
3) Annual Large Purchase (LG PURCH) actions 
d. Performance Indicators 
1) Annual and Quarterly Supply Maternal Availability (SMA) 
2) Annual Number of Backorders (BB) established per year 
3) Annual Material Outstanding Obligations (MOOS) at the end of a fiscal year 
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Collection Of Available Data 
Collection was done manually with the figures coming from retained reports and 
files. Some data could date back as far 1973 while some were only for the last two years. 
Onlv a few data have both annual and quarterly figures available. It 1s anticipated that 
there will be more fluctuations in quarterly data as spending of budgets may follow a 
seasonal effect. On the other hand, annual figures will show smoother trends because 
things tend to even out in the course of the year. Overall, the data collected is a good 
representation of the major functions performed by the ICP’s. 

In view of the scarcity of data, anything available was collected. In most cases, 
a workload indicator was broken down into its subsets ; 1.e., Number of line items into 
Total, Consumables and Repairables. Some variables could also be considered as per- 
formance indicators such as Supply Material Availabilitv, Backorders and Material Ob- 
ligations Outstanding. O& MN and Navy Stock Fund (NSF) obligations were converted 


to FY 87 dollars using inflation factors before they are used in any analysis. Original 


data can be found in Appendices A to D. Appendices A and B show the annual data by 
fiscal year for SPCC and ASO, respectively. The values of O& MN and NSF during the 
years in which they were obligated are listed along with the constant dollar indexes and 
the corresponding constant dollar amounts. Appendices C and D contain quarterly data 
for SPCC and ASO, respectively. The data in the appendices are also grouped in ac- 
cordance with the time intervals of the observations. 

3. Data Analysis 

Exploratory Data Analysis will be used to acquire a basic understanding of data 
sets. Plots of variables against time will show the general trend of the variables. Whether 
SPCC and ASO are similar or not can be shown graphically. 

Scatter plots of O& MN against each workload indicator will show if the re- 
lationship is linear or non-linear. If non-linear, the scatter plot may even suggest a sult- 
able transformation of the variables to express the relationship in a linear form. If a 
pattern can not be clearly determined graphically, a formal correlation analysis will be 
performed. 

The purpose of correlation analysis is to find out how strong the relationship is 
between two variables as measured by the coefficient of correlation. r. The value of r 
ranges from -1.0 for a strong negative correlation, 0 for no correlation, and +1.0 fora 
strong positive correlation. A test of hypothesis at the .05 level of significance will be 
conducted on the coefficient of correlation where the null hypothesis will claim that r 1s 
equal to zero. Variables which do not show favorable correlation with O&MN will not 


be used in regression analvsis. The test statistics [Ref. 6] will be: 





n—-2 

a. =X —— for 970, (1) 
Milnes 

where 


r = coefficient of correlation, 
n = sample size, 


f = t-statistic with n-2 degrees of freedom. 


Beez—7x/n—1 for n> 50, (2) 


where 


z = value of the standard normal deviate. 


4. Model Building 

Data for O& MN and those workload indicators reflecting favorable correlation 
Statistics will be fitted to different regression models and the goodness of fit will be 
evaluated using the criteria described below. The simple linear model will be initially used 
and then, based on the scatter plots and residual analysis, either O& MN or the workload 
indicator or both will be transformed in a way that could “straighten” out the data. 
There are advantages in re-expressing the relationship between variables linearly. Inter- 
pretations are relatively easier and departures from fit are more clearly detected [Ref. 
Ak 

a. Simple Linear Model 


Ve payee, (3) 
where 
Y = value of the dependent variable, OX MN, 
B, = Y-intercept or value of Y when X = 0, 
B, = coefficient of the workload indicator, 
X = value of a specific workload indicator, 


oe) 
I 


error or residual between the value of the dependent variable predicted by 
the regression equation, Y= fb, + B,X, and the actual value observed, Y. All errors are 
assumed to be independent and identically distributed normal random variables with a 
mean of zero and a variance of o°. 

b. Power Model 


Y = bX""e, (4) 
where 
Y = value of the dependent variable, O&MN, 
bm = unknown parameters, 
X = value of a specific workload indicator, 
€ = error or residual. 


This can be transformed to a linear equation by taking the natural logarithm of both 
sides[Ref. 8] as follows. 


InY=Indb+minX+Ine (S) 


The transformed model equation is now in the form of equation (3) and can be handled 
by linear regression. 


c. Exponential Model 


Y = bee, (6) 
where 
vé = value of the dependent variable, OXRMN, 
bm = unknown parameters, 
X = value of a specific workload indicator, 
€ = error or residual. 


This can also be transformed to a linear equation by taking the natural logarithm of 
both sides[Ref. 8] as follows. 


In Y =Inb+ mX + Ine. (7) 


d. Logarithmic Model 


Y=B +B, InXte, (8) 


w 
I 


value of the dependent variable, ORMN, 
B, = Y-intercept, 


coefficient of In X, 


= 
I 


X = value of a specific workload indicator, 
€ = error or residual. 
This is already in the format of equation (3) so this can be handled by linear regression. 
e. Model of Several Functions of X 


Y = Bo t+ BAX) + Bog(X) +... +8, (9) 
where 
Y = value of the dependent variable, O&MN, 
By, B,, 8. = constants, 
f(X) = a function of the independent variable X, 
g(X) = another function of the independent variable X, 


E = error or residual. 
An example is Y = £, + B,X + B,X? + B,;X3 + € which is a polynomial of third degree. 

f. Models With Time Lags 
The general format will be the same as the above equations but the X and Y variables 
will be paired using different time periods. This models are of interest since they will in- 
dicate how long before outputs or performance indicators show the result of resource 
expenditures. Examples are 


Y,=a+ Of{X,_,) +6, (10) 
OF 
Y,=a+ Of{X,4,) +6, (11) 


where 
t = a specific time in either quarter or vear, 
n = ume lag in the same units as t. 
5. Evaluation of Models 
The following criteria will be used to evaluate how well any of the above models 
describes a particular set of data. 
a. Coefficient of Determination 
The proportion of the total variation in the dependent variable Y that is 
explained or accounted for by its relationship with the independent variable X 1s meas- 
ured bv the coefficient of determination, R’. If there is a good fit, the value of R? will 
be near One. |Kher7)} 
b. Standard Deviation of the Residuals 
This quantity, S, is an estimate of o. It measures the magnitude of unex- 
plained variation between the observed and fitted value of the dependent variable. 
Smaller values will indicate better accuracy of prediction by the fitted model. 
c. Residual 
One wav to make a quick and informal check of the assumption that the 
errors of observations are independent is to examine the observed values of the residuals, 
— Y, — Y, The plots of residuals can indicate the nature of a misfit between the model 
and the data in a clear way and can constructively suggest an improved model. For a 
good fit, all residuals should be small and half should be positive and half should be 


negative. 
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Several tvpes of residual plots can be used.[Ref.9] They are: 


1. Plot of residuals against each explanatory variable. The presence of a curvilinear 
relationship suggests that a higher order term, perhaps quadratic in the explanatory 
variable should be added to the model. 


2. Plot of residuals against predicted values from the fitted model. If the variance of 
the residuals seem to increase with the predicted values, a transformation of the 
dependent variable may be in order. 


3. Normal plot of the residuals. Residuals should look pretty much like a sample from 
a normal distribution. 


4. Plot of residuals against time. Data are often collected in time order so even if time 
is not one of the explanatory variables used in the model, these plots sometimes 

lead to the detection of unsuspected patterns due to time.[Ref. 9] 

d. Test for Significance of Coefficients 

A t-test for significance of each coefficient must be conducted. This serves 
to confirm the relationship between X and Y variables and that the coefficient being 
tested is not equal to zero. A significance level less than .05 is considered reasonable to 
indicate that the resulting coefficient 1s not equal to zero. However, the strength of the 


relationship between the dependent and independent variable will still depend on R?. 


B. COMPUTER PROGRAMS USED 

Exploratory data analvsis, regression analysis and all statistical computations for 
both single and multiple variable models were done on the IBM 3033 mainframe com- 
puter at the Naval Postgraduate School using GRAFSTAT, an interactive data analysis 
and graphics system and MINITAB, a general purpose data analysis system and statis- 


tical computing system. 


C. ASSUMPTIONS. 

Gross O& MN obligations and workload indicators will be used in this analysis. The 
ICP’s receive O& MN funds from two sources. Direct O&MN is received from 
NAVSUP so that the ICP’s can perform their missions. In addition, they perform tasks 
and services for Hardware Systems Commands (HSC); namely, the Naval Sea Systems 
Command and the Naval Air Systems Command, and receive Reimbursible O& MN. The 
work performed for the HSC’s involves support for certain weapon systems of special 
interest which include Casualty Report (CASREP) support, requisition expediting, daily 
requisition processing and others. CASREP support involves expeditiously providing to 


the customer repair parts which are urgently needed to bring the system back to opera- 


NI 


tional status. Lack of this CASREP repair parts in the fleet adversely affects the capa- 
bility of a combat unit to perform its missions. 

Reimbursible O& MN is not a small portion of the ICP’s gross O& MN obligations 
(28% for SPCC and 11% for ASO for FY 87). However, it is extremely difficult to sep- 
arate out that portion of any workload indicator attributable to Reimbursible O& MN. 
It is therefore assumed that the ICP produced the gross outputs and achieved overall 
performance indicators by using gross O& MN. 

Since past data are not routinely kept for the purpose of future studies, the time 
intervals for various workload indicators are different. It will be assumed that more ac- 
curate information is obtained by using more observations. Therefore, the time interval 
that provides the most number of data points will be used. 

ICP functions which do not have a known workload indicator, such as host activity 
and base security functions, will be assumed to be insignificant. 

Several factors have significantly changed over the last ten years which affect the 


wav the ICP’s do business. Some of the most significant are: 


1. Depot Level Repairables (DLR) COG migration. 

Until 1981, repairable components used by the fleet and shore establishments 
of the U.S. Navy were managed as free (to the customers) items. While this system 
provided the ultimate user with repairables without charge, it was difficult to 
manage and was determined to be uneconomical. 

In April 1981, stock funding of non-aviation DLR’s began. This resulted in 
repairables being chargable to end users. In April 1985, aviation DLR’s were in- 
cluded in the new system. The intent of this program is to improve the availability 
of these expensive and critical items for the fleet while reducing the overall cost to 
the svstem. This policy change increased the level and scope of managing reparr- 
ables by an ICP. 


2. Advocacy of Competition. 

The law requires maximum use of competition in all purchase actions. This 1s 
intended to ensure that the government pays for an item at a fair price and achieves 
cost savings. This tends to lengthen the amount of time spent by ICP’s in initiating 
purchase actions because of additional steps involved. 


3. Advances in Automation. 
Many tasks performed manually in an ICP have been automated, beginning in 
the late 1970's. However, it is difficult to determine how workload and performance 
indicators have benefited. 
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III. RESULTS OF SINGLE VARIABLE ANALYSIS 


A. DATA ANALYSIS 
1. A Look At The Two Inventory Control Points 

The first concern in the data analysis was whether the two types of ICP’s are 
similar enough to have a common measure of output that would relate well with OXMN 
dollars consumed. Although the two activities perform basically the same major func- 
tions and achieve the same goals, there are several factors which make them different. 
The customer base consists of ships and submarines for SPCC and aircraft for ASO. 
Corrective and preventive maintenance schedules are different among these communi- 
ties. Because the mission profile and weapons systems used by customers differ to a 
great degree, it is to be expected that the support requirements will also be different. 
The approach that will initially be taken here is to find out if there is a systematic re- 
lationship among the variables of the two activities. Perhaps the difference can be ex- 
pressed as a simple multiplicative or additive factor. 

Figures 2 to 4 clearly shows the difference between SPCC and ASO over the last 
ten years. SPCC consistently used more O& MN and have more people in their opera- 
tion. The trend indicates that the gap will continue to increase. ASO obligates more NSF 
and this is supported by the higher total demands from their customers. SPCC’s total 
line items is much higher than ASO’s and this mav be a major reason for the higher end 
strength required to manage the items. SMA is almost the same for both activities and 
it seems that SMA increases with O& MN. 

It is conclusive that SPCC and ASO are so distinctly different that it is impos- 
sible to establish a single variable which will measure their workload in the same manner. 
Since ASO and SPCC can not be treated as identical, their variables will be analyzed 


separately. 
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Figure 2. Graphical Comparison of ICP Resources. 
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Figure 3. Graphical Comparison of ICP Major Workload Indicators. 
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Figure 4. Graphical Comparison of ICP Performance Indicators. 
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2. Correlation Between Variables 

Appendix E contains scatter plots of the dependent variable, O& MN, against 
each independent variable. It is evident that O& MN does not show a clear pattern or 
relationship with most of the variables. Most plots tend to be linear but the presence 
of wide variance and dispersion suggests that transformation of some variables may be 
necessary to obtain the best fit. Due to the large number of candidate variables only 
those with reasonable correlation with O& MN were carried on to the next step of model 
fitting. Some variables were confirmed to have no correlation at all with O&MN after 
applying the formal test for correlation. Some variables showed strong, negative but 
unfavorable correlation with O& MN and were eliminated. Some variables like number 
of Backorders can cause O& MN to increase although the variable itself is decreasing. 
It takes more effort and money to achieve a reduction in the number of backorders, and 
this is a good indicator of performance. On the other hand, when the total number of 
purchase actions decrease, there should be an accompanying reduction rather than an 
increase in O&MN because of smaller output. This matter was discussed with 
Commander Doug Hartman of NAVSUP and he concurred that the decreasing trend in 
the number of purchase actions 1s so significant that it can not be attributed to compe- 
tition. 

The number of demands is a function of equipment breakdown and availability 
of funds in the operating forces and 1s not controlled by the ICP’s O&MN so it can still 
be used even with negative correlation with O& MN. 

End Strength as a resource variable shows the strongest correlation with 
O&MN but it is almost synonymous with it because most of O& MN is used to pav for 
salaries of personnel. It was therefore dropped from the list of candidate explanatory 
variables. 

NSF obligations which are believed to dictate the tempo and amount of work 
in NAVSUP activities did not show any correlation at all with the other variables. 

At this point in the analysis, 1t can be concluded that, although the ICP’s are 
using various workload indicators, many do not really relate well with O&MN. The 
following variables were considered to relate sufficiently that they will be used in the 


regression analysis. 
1. Number of Line Items 
2. Number of Demands 
3. SMA 


es 


4. Backorders 
5. MOOS 


Plots of quarterly O& MN obligations and the major variables against time are 
shown in Figures 5 and 6. There appears to be no evidence of seasonality except perhaps 
in O&MN. Comparing the plots of annual data over time in Figures | to 3 and the plots 
of quarterly data over time in Figures 4 and 5, it appears that it will be more difficult to 
fit models to the quarterly data because they contain extreme random fluctuations. Data 
tend to even out during the course of the year and this explains the somewhat smoother 
curve for annual data. The significant decrease in the Total Line Items during the first 
quarter of FY 83 for SPCC and third quarter of FY 83 for ASO resulted from the Dep- 
uty Secretary of Defense (DEPSECDEF) Memorandum of 7 July 1981 which directed 
the armed services to transfer 200,000 consumable line items to Defense Logistics 
Agency (DLA) beginning in April 1982. The Navv’s share of about 71,000 line items 
were distributed between the two ICP’s: 41,000 for SPCC and 30,000 for ASO. 
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Figure 5. Plot of Major SPCC Quarterly Variables Against Time. 
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Figure 6. Plot of Major ASO Quarterly Variables Against Time. 


B. REGRESSION ANALYSIS 

The best models for each variable which passed the criteria mentioned in the first 
section of Chapter II are shown in Tables | through 4. The indicators are listed in the 
table according to the values of R?. The variables with the highest R? (R? = 20.0) will be 
considered as the best indicators. The quarterly Repairable Line Items for ASO is listed 


although its R? is only 14.6 since it is the onlv ASO quarterly variable which passed the 
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criteria for test of significance. Plots of the resulting regression curves are shown 1n 
Figures 7, 8, and 9. The plot of residuals against each variable are also shown in Figures 
7 through 9 and appear to show randomness and normality for all models. Note that 
Tables 1 and 2 correspond to annual values and Tables 3 and 4 to quarterly values. 

As the tables and figures show, the effect on O&MN of all of the variables was 
basically described by the linear model but improvements were achieved by applying 
various transformations. The biggest improvement in the value of R? was achieved by 
the time lag model for the annual SMA for ASO, from 11.0 for no lag to 56.9 for a two 
year lag. Most of the increases in R? are small, about five percent on the average. 

Overall, as can be seen from Tables 1 through 4, there are many workload indicators 
which can form statistically significant regression models to relate to OR MN. However, 
the variables which achieved the best fits with O& MN are from the group of Repairable 
Line Items. Thus, if only a single workload indicator was sought, the number of repair- 
able line items is the best candidate. It 1s not surprising that Repairable Line Items are 
the leading indicators. The data are probably dominated by the effect of the major 
policy change of stockfunding of Depot Level Repairable which started in 1981 at SPCC 
and 1985 at ASO. The technological trend is also towards acquisition of additional 
complex and sophisticated weapons systems supported by repairable components. 

The value of R? for all top indicators are rather low to be considered as reliable 
predictors. To have an idea of how these models would do when used in a prediction, 
consider the confidence interval for the best model, 7 COG Demand for SPCC. There is 
no data available for FY 88 which can be used for prediction. However, if the value of 
O&MN for FY 88 were to be predicted, with a standard deviation of the residuals equal 
to $9,439,000 and 10 degrees of freedom, the actual value is expected to be within plus 
or minus $21,000.000 of the estimated value at a confidence level of 95 percent. With 
SPCC’s gross annual O& MN in the range of $150,000,000 this is a very wide interval to 
consider as accurate prediction. 

Although the single variable models appear to be statistically significant by satisfy- 
ing the criteria to be good models, their predictive abilities are unreliable. An alternative 
is to obtain more accurate models by using multiple variables in a model. This will be 


Eieet@yic in the nextechapter. 
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Table 1. BEST FITS FOR LEADING SPCC ANNUAL INDICATORS. 
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Table 2. BEST FITS FOR LEADING ASO ANNUAL INDICATORS. 
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Table 3. BEST FITS FOR LEADING SPCC QUARTERLY Ten a 
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Table 4. BEST FIT FOR LEADING ASO QUARTERLY INDICATOR. 
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Figure 7. Model Fit and Residual Plots for the Leading Indicators of SPCC. 
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Figure 8. Model Fit and Residual Plots for the Leading Indicators of SPCC. 
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Figure 9. Model Fit and Residual Plots for the Leading Indicators of ASO. 
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IV. MULTIPLE REGRESSION MODEL 


For models with multiple independent variables, all variables must have the same 
number of observations. In this chapter, annual and quarterly variables from two time 
intervals will be used for both ASO and SPCC. 1976-1987 provides many observations 
and allows the use of most of the variables. 1981-1987 allows the use of all variables but 
the number of variables that can be used in a regression model is limited to a maximum 
of five. There are only seven observations and it is required to have at least one degree 
of freedom in a regression equation. In spite of this limitation, the data for this time in- 
terval is worth looking at because it reflects the effect of such recent policy and proce- 


dural changes as the stockfunding of repairables. 


A. GENERAL MODEL 


The general form of the multiple regression model ts 


Y = Bo + BX) + Bag(X2) + B3h(X, Xz). + & (10) 
where 

7 = the dependent variable, O&MN, 

Bb, = constants 

A(X,) == a function of variable X,, 

e(X,) = a function of variable X,, 

A(X,. X,) = a function of variables X, and X,, 

€ = error or residual. 


An example of a function involving interaction of two independent variables is 
Ai, Xp) = XA. 


B. METHODS 
1. All Possible Regression 

This is a cumbersome method especially if there are a lot of variables . The 
procedure involves running regression in sets of one, two, three and up to the maximum 
number of variables, say k, and recording the combinations with the highest R? in each 
set. These leaders are then examined for consistency in the pattern of variables. This 1s 
not a highly recommended method as the number of trials could go as high as 2*. [Ref. 
8] 
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2. Backward Elimination 
When the sets of data allow, this is the most common practice in developing 
multiple regression models. The steps are: 
1. Begin with all variables X,, X,, X3...X,. 
Pee alculate the regression of Y on X,°7X,. 
3. Drop out each variable X, which has a relatively insignificant t-statistic. 
4 


. Recalculate the regression of Y on just the variables remaining. [Ref 10] 


3. Forward Selection 
This procedure is otherwise known as stepwise regression. A correlation matrix 
is used to select the variables which will be added to the regression model. The variable 
with the highest correlation with O& MN is selected first to be followed by variables with 


high correlation with O& MN but low correlation with variables already in the equation. 


C. EVALUATION OF THE MODEL 
The same criteria used in the single variable models above can be applied to 


multivariate models with two modifications: 


1. Adjusted R? must be used to compensate for the different number of variables in 
the models. 

2. An F-test must be conducted in order to test the significance of the overall model. 
A significance level less than .05 is considered reasonable to indicate that the 
overall model is reasonably valid. 

3. The 95 percent confidence interval 1s included with the other results to show the 
predictive ability of the model. 
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D. RESULTS OF MULTIPLE VARIABLE ANALYSIS 
1. Annual Variables For The Time Interval From 1976 to 1987 
For the time interval from 1976 to 1987, there was a sufficient number of ob- 
servations to use the backward elimination method. The best model for SPCC came out 
to be a linear combination of 7COG Line Items and 7COG Demands. These same var- 
lables were the leaders in the single variable models for SPCC. The results are summa- 


rized in Table 5. The regression equation 1s 


O&MN(SPCC) = 39222 + 0.816 (TCOGLN + 0.154 (7TCOGDEM). 


Table 5. SUMMARY OF RESULTS FOR SPCC ANNUAL VARIABLES FROM 
1976 TO 1987. 


Predictor Coe Stdev t-ratio Sig. Level 
Constant 39222 19058 2.06 0.069 
T7TCOGLI 0.8162 0.3034 2339 0.025 
TCOGDEM _— 0.15416 0.03621 4.26 0.002 


s = 7407 R-sq = 87.4%  R-sq(adj) = 84.6% 


Analysis of Variance 

SOUKCE. JDT SS MS Sig. Level 
Regression 2 3416467200 1708233472 0.0001 
Error 9 493809152 54867680 

Total bl 3910276552 





95% Confidence Interval: Y + $16,754,000 


The formula used for the 95 percent confidence interval is Y + f,,., x S where 
¥’ is the predicted O& MN, 4&,)) iS the t-statistic at o=.05 and S=standard deviation. 
This interval indicates the range of the actual value that the dependent variable can take 


on as predicted by the regression equation. 
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The best model for ASO came out to be a linear combination of SMA and 
Backorders. SMA in this case did not have the time lag factor used in the single variable 
analysis. However, when SMA and Backorders were taken as single predictors for 
O&MWN for this time interval 1976 to 1987, SMA resulted with R? of 43.4 and Backorder 
had an R? of 20.5. Although SMA and Backorder have a high negative correlation, they 
combine nicely to explain the behavior of O& MN for this time interval. The results are 


summarized in Table 6. The regression equation 1s 


O&MN(ASO) = — 687881 + 8788(SMA) + 0.352(BB). 


Table 6. SUMMARY OF RESULTS FOR ASO ANNUAL VARIABLES FROM 
1976 TO 1987. 


Predictor Coef Stdev t-ratio Sig. Level 
Constant -687881 106269 -6.47 0.0001 
SMA 8788 1147 7.66 0.00003 
BB 0.35248 0.05628 6.26 0.0001 


s = 2917 R-sq = 90.4% R-sq(adj) = 88.3% 


Analysis of Variance 

Bou RCE DF SS MS Sig. Level 
Regression 2 720624384 360312064 0.0005 
error 9 76561616 8506846 

Total 11 797185792 


95% Confidence Interval: + $6,600,000 
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2. Annual variables For The Time Interval From 1981 to 1987 
The forward selection method was the most suitable for this time interval be- 
cause the number of variables exceeds the number of observations. The best model for 
SPCC came out to be a combination of Total Line Items, 7COG Demands, MOOS, and 
the squared quantity of 7COG Line Items. The results are summarized in Table 7. The 
regression equation 1s 


O&MN(SPCC) = 41095 + .000009(7COGLI — 0.430(TOTLD) + 0.368(7COGDEM) + 
1.00(.MOOS). 


Table 7. SUMMARY OF RESULTS FOR SPCC ANNUAL VARIABLES FROM 
1981 TO 1987. 


Predictor Goer Stdev t-ratio Sig. Level 
Constant 41095 29857 1.38 0.3016 
TCOGLI = =0.00000854 = 0.00000189 4.51 0.0458 
TORE -0.42956 0.06905 -6.22 0.0249 
TCOGDEM 0.36834 0.06842 o-oo = 0.0329 
MOOS 1.0032 0.1209 §.30 0.0142 


s= 1911 R-sq = 99.6%  R-sq(adj) = 98.9% 


Analvsis of Variance 

SOURCE DF SS MS Sige exe) 
Regression 4 2061276416 515319040 0.0116 
Error 2 7304947 3652473 

Total 6 2068581120 





95% Confidence Interval: yee S8.200.000 
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The best model for ASO came out be a linear combination of 1R COG Line 
Items, 7R COG Line Items, Total Line Items, 1R COG Demand, and 7R COG De- 


mands. The results are summarized in Table 8. The regression equation 1s 


O&MN(ASO) = 132326 + 0.524(1RCOGLD + 1.41(7RCOGLD — 
0.526(TOTLI — 0.131(1RCOGDEM) + 0.104(7RCOGDEM). 


Table 8. SUMMARY OF RESULTS FOR ASO ANNUAL VARIABLES FROM 
1981 TO 1987. 


Predictor Coef Stdev __t-ratio Sig. Level 
Constant 132326 524 P2602 0.0025 
IRLI 0.524117 0.000900 582.03 0.0011 
TRLI 1.41089 0.00431 327.64 0.0019 
BOULL -0.526385 0.000667 -789.51 0.0008 
IRDEM_ -0.131244 0.000326 -402.49 0.0016 
TRDEM — 0.104432 0.000192 544.29 0.0012 


s = 15.93 R-sq = 99.5%  R-sq(adj) = 99.0% 


Analysis of Variance 

SOURCE IDS SS MS Sig. Level 
Regression 5 672386816 134477360 0.0018 
Error l 254 254 

Total 6 672386816 





95% Confidence Interval: Y+ $202,000 
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Another combination of ASO annual variables which fitted well to a multiple 
model consist of 1R Line Items, 7R Line Items, 1R Demands, and Backorders. However, 
the coefficient for 7R Line Items becomes significant at a level of 0.0625 which 1s higher 
than the usual 0.05 used to reject the hypothesis that the coefficient is different from 


zero. The results are summarized in Table 9. The regression equation 1s 


O& MN(ASO) = 240447 — 0.482(1RCOGLD — 3.47(7RCOGLD) + 0.314(1RCOGDEM) — 
0.460(BB). 


Table 9. SUMMARY OF RESULTS FOR ASO ANNUAL VARIABLES FROM 
1981 TO 1987. 


Predictor Coef Stdev t-ratio Sig. Level 
Constant 240447 60381 3.98 O0577 
IRLI -0.48233 0.08099 -5.96 0.0270 
Tel -3.4736 0.9116 -3.8] 0 062s 
]IRDEM O16 9> 0.03967 7.91 0.0156 
BB -0.45973 0.05693 -§.07 0.0150 


s = 1928 R-sq = 98.9%  R-sq(adj) = 96.7% 


Analysis of Variance 

SOURCE DE oS MS Sic. Wevel 
Regression 4 664952576 166238144 0.03 
ETrer 2 7434638 S79 

Total 6 672387072 


95% Confidence Interval: Y + $8,300,000 
This interval is bigger than the previous model. 





All the above models appear to be good models based on the significance levels 
and R?. However, their quality is restricted by the number of observations, or conse- 
quently, the degrees of freedom left when many variables are entered into the model. 
This causes the confidence interval to be extremely wide to be considered accurate for 
prediction. The validity of these models needs to be tested against data for FY 1988 be- 
fore they can be considered practically useful. Usually, the data for the last period can 
be held over to test a model. However, the limited number of observations did not allow 


this procedure to be done in this thesis. 
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3. Quarterly Variables 
The method of all possible regression was applied to the quarterly data for both 
ASO and SPCC for the periods of 1976 to 1987 and 1981 to 1987 but did not produce 
satisfactory results. 
4. Time Series Regression 
In order to test how the variables would relate over time, stepwise regression 
was performed for the annuai data from 1976 to 1987 for both ASO and SPCC starting 
with observations from 1976 to 1981 then incrementing by one year until 1987. The re- 
sults shown below indicate that the variables are very volatile; i.e., the leading indicators 
change with time. Only SPCC shows a consistent trend that 7COG Demands and Line 
Items have the best relationship with O& MN. The SPCC and ASO results for the period 
from 1976 to 1987 are the same models shown in pages 30 and 31. 


Period Leading Variables R-Squared 
1976-1981 Total Demand 56.81 
1976-1982 Total Demand S702 
1976-1983 No variable can form a good model N/A 
1976-1984 7COG Demands, 7COG Line Items, SMA 96.74 
1976-1985 7COG Demands, 7COG Line Items, SMA 90.80 
1976-1986 7COG Demands, 7COG Line Items 82.98 
1976-1987  7COG Demands, 7COG Line Items 87.39 

And the results for ASO are as follows: 

Period Leading Variables R-Squared 
1976-1981 IR Demand 76.83 
1976-1982 1R Demand 67.85 
1976-1983 1R Demand 80.85 
1976-1984 Total Demands, Backorders §2.43 
1976-1985 7R Demand, 1R Demand 90.56 
1976-1986 | 7R Demand, 1R Demand, Repairable L.I. 93.29 
1976-1987 SMA, Backorders 90.40 


The significance of these time series models is that since the relationship of 
O&MN to the various variables changes with time, it may be extremely riskv to forecast 
O&MN by a regression model using the workload indicators presently being used at 
Navy ICP’s. It becomes even more unreliable when a model contains only one variable 


because the variable could lose its relative significance the following year. 
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A. 


V. SUMMARY, CONCLUSIONS AND RECOMMENDATIONS 


SUMMARY 


This thesis applied data analysis and regression analysis to find a predictive model 


relating gross O& MN obligations by Navy ICP’s to their workload indicators. Both 


single and multiple variable analyses were conducted on annual and quarterly data for 
ASO and SPCC to find the best model. 


B. CONCLUSIONS 


lis 


Can 


C. 


The two Navy ICP’s are distinctly different and there 1s no systematic relationship 
between their variables. There 1s no single one which can serve as a common 
measure for both activities. 


Many of the workload indicators being used by the ICP’s do not really show fa- 
vorable correlation with O& MN and thus, their usefulness as indicators is ques- 
tionable. Correlation analvsis showed that only the indicators related to the 
Number of Line Items, Number of Demands, Backorders, MOOS and SMA 
showed significant relationships with O& MN. 


When data for the ICP’s were analyzed separately using regression, the family of 
Repairable Line Items came out to be the major leading indicator for both activ- 
ities. SPCC’s O& MN has a linear relationship with 7 COG Line Items, a subset 
of Repairables, while ASO’s O& MN has a quadratic relationship with the total 
number of Repairables. 


Single variable models do not do very well at explaining the behavior of O&MN. 
One variable alone can not possibly capture the complexity of activities being 
conducted by an ICP. 


Multiple variable models present a better alternative for forecasting OXMN. Un- 
fortunately, there is not enough data to verify the validity of the models. More data 
needs to be obtained before the multiple variable models become practical to use. 


ICP’s are complex and dynamic activities where doing business requires constantly 
adapting to changes in policies and procedures caused by rapid advancement in 
technology and demand for the highest state of readiness in the armed forces while 
Operating in an environment of constrained resources. The strength of relationship 
between the resource, O& MN, and the workload indicators can be expected to 
continue changing over time. 


RECOMMENDATIONS 


The leading indicators appear to be the family of Repairable Line Items and their 


Demands from customers. While the data for SPCC showed evidence that the effect of 
stockfunding of DLR’s has stabilized, the data for ASO is still uncertain. This 1s under- . 


standable since SPCC started with this policy change almost five years earlier than ASO. 
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It is therefore recommended that data for the number of Repairable Line Items and their 
Demands be tracked annually for several more years and that data begin with the base 
years of 1981 for SPCC and 1985 for ASO. When the data appear to be settling down, 
then a more accurate predictive model may be developed. Meanwhile, as a short term 
alternative while accumulating more data, the best models presented in this thesis may 
be tested for their validity when FY 88 data becomes available. 

All data for workload and performance indicators for the ICP’s show what was done 
by personnel who performed work which directly affected the workload and performance 
indicators. On the other hand, O& MN data included costs for all personnel. As men- 
tioned in Chapter 1, gross O&MN consist of direct O&MN from NAVSUP and 
reimbursibles from HSC’s. This category of direct as presently applied to O& MN 1s too 
broad to allow breakdown between “direct” personnel, those who perform: work which 
directly impacts workload indicators, and “indirect” personnel, those who perform sup- 
port functions. The poor fits obtained in this study could be due to the presence of “in- 
direct” personnel in the O&MN figures. There is a need to institute a personnel 
accounting scheme that enables measurement of “direct” versus “indirect” personnel. 
This might enable better fits between workload indicators and “direct” O& MN. Also, 
this categorization of “direct” and “indirect” personnel could serve as a management tool 
since a comparison of the trends between “direct” O& MN and a workload indicator can 
readily show the efficiency of work among “direct” personnel. An increase in the “indi- 
rect’ O& MN may also indicate the amount of nonproductive work being done at the 
eR Ss. 
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APPENDIX C. QUARTERLY DATA FOR SPCC 
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APPENDIX D. QUARTERLY DATA FOR ASO 
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APPENDIX E. SCATTER PLOTS 
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Figure 10. Scatter Plots of SPCC Annual Variables. 
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Figure 11. Scatter Plots of SPCC Annual Variables. 
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Figure 12. Scatter Plots of SPCC Annual Variables. 
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Figure 13. Scatter Plots of SPCC Annual Variables. 
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Figure 14. Scatter Plots of SPCC Annual Variables. 
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Figure 15. Scatter Plots of SPCC Quarterly Variables. 
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Figure 16. Scatter Plots of SPCC Quarterly Variables. 
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Figure 17. Scatter Plots of ASO Annual Variables. 
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Figure 18. Scatter Plots of ASO Annual Variables. 


i 


1R COG DEMANDS VS O&MN 7R COG DEMANDS VS O&MN 


10 110 


80 
80 


90 
O&MN ($000,000 
IF) 110 


O&MN ($000,000) 


70 


800 1000 1100 1200 1300 600 650 700 750 
1R COG DEMANDS (000) 7R COG DEMANDS (000) 


TOTAL PURCHASE ACTIONS VS O&MN SMALL PURCHASES VS O&MN 


115 


O&MN ($000,000 
ibs 105 Ae 


95 


90 


= be) 60 


60 65 i 45 50 Shs) 
TOTAL PURCHASE ACTIONS (000) SMALL PURCHASE ACTIONS (000) 





Figure 19. Scatter Plots of ASO Annual Variables. 
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Figure 20. Scatter Plots of ASO Annual Variables. 
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Figure 21. Scatter Plots of ASO Quarterly Variables. 
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Figure 22. Scatter Plots of ASO Quarterly Variables. 
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